System and method for providing a two-way interactive 3d experience

ABSTRACT

A system for providing a two-way interactive 3D experience includes a first video capture system configured to capture a first set of images of a first person in a first location, and a first display system in the first location. A second video capture system is configured to capture a second set of images of a second person in a second location. A second display system is in the second location. A two-way communication link is configured to deliver the first set of images to the second display system for display and deliver the second set of images to the first display system for display. The second display system is configured to generate a substantially life-sized 3D display of the first person based on the first set of images.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No.13/459,792, entitled “SYSTEM AND METHOD FOR PROVIDING A TWO-WAYINTERACTIVE 3D EXPERIENCE” filed on Apr. 30, 2012, and incorporatedherein by reference.

BACKGROUND

Multiple projector systems have been developed to project multiple videoimages to a common display location, such as a screen or wall, toproduce a composite display. A composite display is one in which asingle image is produced using multiple projectors, with each projectorproducing a portion or component of the total image. These displaysystems can be configured to allow multiple sub-frames to overlapcompletely, not at all, or anything in between, or to provide multipleseparate composite images. Yet another application for a multipleprojector system is the production of three-dimensional (“3D”) images.

One challenge associated with composite images is consistentreproduction of color, brightness, etc., across multiple displays ormultiple channels on the same display. For example, brightness and colorintensity can vary within each individual portion of a compositedisplay, with the result that the composite image has noticeableirregularities. It can also be difficult to calibrate and reconfiguremultiple projector systems between various display configurations, suchas to allow content to flow across multiple screens in a single display,while also providing consistent brightness, color, etc. Additionally,the production of 3D images using a multiple projector system hastypically been complicated and difficult.

For these and other reasons, a need exists for the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an image display systemconfigured to produce a composite image using multiple projectors.

FIG. 2 is a diagram illustrating a multi-projector system and acomposite display produced thereby according to one embodiment.

FIG. 3 is a diagram illustrating a multi-projector system and display inwhich the projectors are divided into multiple sub-groups, to producemultiple composite images on a bent backdrop-type screen according toone embodiment.

FIG. 4 is a flow diagram illustrating a method for producing aconsistent composite image across multiple displays or multiple channelson the same display using a common microprocessor control systemaccording to one embodiment.

FIG. 5 is a diagram illustrating a system for providing a two-way(full-duplex) interactive 3D experience according to one embodiment.

FIG. 6 is a diagram illustrating a system for providing a two-wayinteractive 3D experience according to another embodiment.

FIG. 7 is a diagram illustrating a system for providing a two-wayinteractive 3D experience according to yet another embodiment.

FIG. 8 is a block diagram illustrating elements of the system shown inFIG. 7 for providing audio and video information from the first room tothe second and third rooms according to one embodiment.

FIG. 9 is a block diagram illustrating elements of the system shown inFIG. 7 for providing audio and video information from the second roomand the third room to the first room according to one embodiment.

FIG. 10 is a flow diagram illustrating a method for providing a two-wayinteractive 3D experience according to one embodiment.

DETAILED DESCRIPTION

In the following detailed description, reference is made to theaccompanying drawings which form a part hereof, and in which is shown byway of illustration specific embodiments in which the invention may bepracticed. In this regard, directional terminology, such as “top,”“bottom,” “front,” “back,” “leading,” “trailing,” etc., is used withreference to the orientation of the Figure(s) being described. Becausecomponents of embodiments can be positioned in a number of differentorientations, the directional terminology is used for purposes ofillustration and is in no way limiting. It is to be understood thatother embodiments may be utilized and structural or logical changes maybe made without departing from the scope of the present invention. Thefollowing detailed description, therefore, is not to be taken in alimiting sense, and the scope of the present invention is defined by theappended claims. It is to be understood that features of the variousembodiments described herein may be combined with each other, unlessspecifically noted otherwise.

As used herein, the term “sub-frame” refers to that portion of a displayimage that is produced by a single projector. A complete display imageproduced by multiple sub-frames from multiple projectors is referred toas a “composite image.” It is to be understood that a composite imagecan be produced by a sub-group of projectors (i.e. fewer than all of theprojectors) in a multiple projector system.

One embodiment is directed to a system and method that uses 3D displaysand cameras to create life-sized and natural aspect ratio “celebritywall” experiences for immersive entertainment. One embodiment uses 3Ddisplay(s) and 3D camera(s) to create a life-sized, life-like 3Dexperience between at least two geographically dispersed locations(e.g., rooms in different buildings, different cities, different states,and/or different countries). One embodiment leverages natural aspectratios to provide a more immersive and interactive experience betweenpeople located at geographically dispersed locations, such as acelebrity and his/her fans.

Some embodiments include creating life-sized superwide displays thatprovide a just-like-being-there 3D courtside experience at a basketballgame or life-sized displays that demonstrate various 3D views of aclothing line for fashion/retail. Some embodiments augment theseexperiences by creating life-sized 3D displays of a more natural aspectratio that enable talent (e.g. celebrities, athletes, artists, and VIPs)to reach a much larger and more geographically dispersed audience.Furthermore, two-way 3D celebrity walls (including life-sized 3Ddisplays and 3D cameras) enable the sports athlete or artist to talk tofans virtually, as though just like being there. In some embodiments,this is expanded to support multiple locations, positioned andarchitected to make the virtual experience look natural. One embodimentextends the reach of the celebrity, drastically reduces travel costs,and creates a more compelling virtual experience. The system can also bea key differentiator to help with sales support, with lead designer(s)being able to talk through dress design with potential high endcustomers, showing one-of-a-kind dresses located in a different part ofthe world.

To achieve the life sizes for an immersive 3D display, one embodimentleverages multiple projectors to create a high quality, high resolution,seamless, and yet cost effective solution. Similarly, multiple camerasare used to capture imagery with appropriate resolution and aspectratio. Empirically, there is a more natural experience and analmost-life-like feeling when viewing images of people between 80% to120% actual size, in contrast to imagery on displays of typical sizesand aspect ratios. Moreover, scaling to the correct size and utilizing3D encourages so-called visual grazing to further create an immersiveexperience.

Some embodiments allow special guests the opportunity to interact withtalent in ways they have never experienced before. Utilizing life-sizeddisplays and 3D cameras, when the special guests interact with thetalent, they will have a true-to-life experience and the feeling ofactually meeting them in-person, without the talent actually being inthe same location.

In one embodiment, the primary fan site consists of a multi-projector 3Ddisplay system in a size and aspect ratio that are appropriate for thetalent. For Example, the display would be about 5′×8′ to create alife-like experience of interacting with a professional athlete. Thedisplay solution creates a seamless 3D display in the appropriate aspectratio. Geometric and color differences among the projectors areautomatically corrected to deliver a high quality result. Likewise, onthe celebrity side, two or more cameras are used to form the appropriate3D imagery in an appropriate aspect ratio. For example, for a moreportrait oriented display, two portrait oriented high-definition (HD)cameras are used to capture portrait oriented HD 3D imagery. Providingdifferent aspect ratios involves using additional cameras to stitch andblend the various camera images to form the appropriate left-right eyepair matched to the display aspect ratio.

To create a two-way experience, additional displays and cameras are usedfor full duplex. 3D portals are used in one embodiment for eachadditional fan site. On the talent side, the viewing experience may be2D or 3D. Connection among the different sites may be facilitated usingvideo networks (e.g., multiple fiber/HD-SDI links) or data networks.Audio (microphones and speakers, including possibly directional) at eachsite is managed and interconnected. To create a natural multi-siteexperience, the positioning of the walls, the cameras, and theparticipants' relative views, are all taken into account. In oneembodiment, the cameras are positioned with respect to the walls in sucha way to maximize eye contact among sites.

“Portrait wall” or “celebrity wall” embodiments of different sizes havebeen constructed, up to 9′ tall, using 3D display systems with 6-8projectors seamlessly blended and tiled together, coupled with twoportrait oriented cameras to create a live two-way 3D capture anddisplay system with audio.

One embodiment facilitates a real-like 3D video communication betweenthe celebrity/talent site and the fan site(s). It also could be designedto enable a one-to-many experience, so that the talent could beinteracting with multiple fan sites simultaneously. The “fan” experienceis life-sized (life-like and immersive) and uses a natural aspect ratio(more portrait appropriate for a single person). Many applicationsinclude sports, concerts, gaming, and fashion/retail. This is a uniquebenefit for the talent and special guests. The talent will be able toreach out to more people and the special guests will have greateraccess.

One embodiment uses scalable camera and projector arrays to deliver highquality, life-sized, immersive content. In contrast to standardentertainment formats such as 16:9 HD and 2.35:1 cinema, other aspectratios are used to bring an enhanced 3D experience. One embodiment usesa wider panoramic 5:1 view with sufficient resolution to deliver theentire field of view (e.g., the full length of a basketball court or thebreadth of a concert stage), which gives a closer approximation to thein-arena experience. The fan watches the action move across the screenrather than having the screen follow the action. As with the real venue,they are free to let their eyes explore—to the scoreboard, players onthe sidelines, cheerleaders, other local attendees, etc., all withsufficient resolution to be naturally drawn into the 3D scene.

Scenarios for the techniques described herein include, for example, thefollowing: (1) Enticement for season ticket holders, to interact withtheir favorite player; (2) an opportunity for VIPs to have specialaccess; (3) celebrity Meet and Greet; (4) Interviews; and (5) pre-gameand post-game chalk talks. People that would be interested in using thetechniques described herein would include, for example, the following:(1) Fans wanting to “meet” their favorite player/performer; (2) teamowners wanting to enhance their fan experience; (3) event organizers whowant a unique experience for their customers; (4) corporate marketingpeople, who may use this to entice their clients; (5) performers whowant to interact with their fan base to help sell albums or tickets.

FIG. 1 is a block diagram illustrating a prior art multi-projector imagedisplay system 100 suitable for use in various embodiments describedherein. The image display system 100 processes image data 102 andgenerates a corresponding displayed image 114. The displayed image 114is defined to include any pictorial, graphical, or textural characters,symbols, illustrations, or other representations of information.

In one embodiment, the image display system 100 includes an image framebuffer 104, a sub-frame generator 108, projectors 112A-112C(collectively referred to as projectors 112), camera 122, and acalibration unit 124. The image frame buffer 104 receives and buffersimage data 102 to create image frames 106. The sub-frame generator 108processes the image frames 106 to define corresponding image sub-frames110A-110C (collectively referred to as sub-frames 110). In oneembodiment, for each image frame 106, the sub-frame generator 108generates one sub-frame 110A for projector 112A, one sub-frame 1108 forprojector 1128, and one sub-frame 110C for projector 112C. Thesub-frames 110A-110C are received by the projectors 112A-112C,respectively, and stored in the image frame buffers 113A-113C(collectively referred to as image frame buffers 113), respectively. Theprojectors 112A-112C project the sub-frames 110A-110C, respectively,onto the target surface 116 to produce the displayed image 114 forviewing by a user.

The image frame buffer 104 includes memory for storing image data 102for one or more image frames 106. Thus, the image frame buffer 104constitutes a database of one or more image frames 106. The image framebuffers 113 also include memory for storing sub-frames 110. Examples ofimage frame buffers 104 and 113 include non-volatile memory (e.g., ahard disk drive or other persistent storage device) and may includevolatile memory (e.g., random access memory (RAM)).

The sub-frame generator 108 receives and processes image frames 106 todefine a plurality of image sub-frames 110. The sub-frame generator 108generates sub-frames 110 based on the image data in image frames 106. Inone embodiment, the sub-frame generator 108 generates image sub-frames110 having a resolution that matches the resolution of the projectors112, which is less than the resolution of image frames 106 in oneembodiment. The sub-frames 110 each include a plurality of columns and aplurality of rows of individual pixels representing a subset of an imageframe 106.

The projectors 112 receive image sub-frames 110 from the sub-framegenerator 108 and, in one embodiment, simultaneously project the imagesub-frames 110 onto the target surface 116 at overlapping and/orspatially offset positions to produce the displayed image 114. In oneembodiment, the display system 100 is configured to give the appearanceto the human eye of high-resolution displayed images 114 by displayingoverlapping lower-resolution sub-frames 110 from multiple projectors112. These overlapping sub-frames can be spatially shifted or havearbitrary geometric transformations with respect to one another. In oneembodiment, the projection of overlapping sub-frames 110 gives theappearance of enhanced resolution (i.e., higher resolution than thesub-frames 110 themselves). Approaches have been developed fordetermining appropriate values for the sub-frames 110 so that theresulting displayed image 114 produced by the projected sub-frames 110is close in appearance to how the high-resolution image (e.g., imageframe 106) from which the sub-frames 110 were derived would appear ifdisplayed directly.

It will be understood by a person of ordinary skill in the art that thefunctions performed by the sub-frame generator 108 may be implemented inhardware, software, firmware, or any combination thereof. Theimplementation may be via a microprocessor, programmable logic device,or state machine. Components of the system may reside in software on oneor more computer-readable media devices. The term computer-readablemedia as used herein is defined to include any kind of memory, volatileor non-volatile, such as floppy disks, hard disks, CD-ROMs, flashmemory, read-only memory, and random access memory.

Also shown in FIG. 1 is reference projector 118 with an image framebuffer 120. The reference projector 118 is shown in hidden lines in FIG.1 because, in one embodiment, the projector 118 is not an actualprojector, but rather is a hypothetical high-resolution referenceprojector that is used in an image formation model for generatingoptimal sub-frames 110. In one embodiment, the location of one of theactual projectors 112 can be defined to be the location of the referenceprojector 118. The display system 100 can also include a camera 122 anda calibration unit 124, which can be used to automatically determine ageometric mapping between each projector 112 and the reference projector118.

The image display system 100 can include hardware, software, firmware,or a combination of these. In one embodiment, one or more components ofthe image display system 100 (e.g. the frame buffer 104, sub-framegenerator 108 and calibration unit 124) are included in a computer,computer server, or other microprocessor-based system capable ofperforming a sequence of logic operations. Such a system is generallyreferred to herein as a “controller” for the multi-projector system. Inaddition, processing can be distributed throughout the system withindividual portions being implemented in separate system components,such as in a networked or multiple computing unit environment (e.g.clustered computers).

While the embodiment shown in FIG. 1 includes three projectors, and onecamera, these quantities of components are only exemplary. For example,another embodiment of a multi-projector system 200 is shown in pictorialform in FIG. 2. This embodiment includes twelve projectors 202 a-1, alloriented to produce a single composite image 204 on a display surface206. As shown in this example, the twelve projectors produce twelvesub-frames, labeled 208 a-1, which in this figure are combined togetherto provide a single wide format composite image 204. While thesuperimposed sub-frames 208 are shown spatially offset from each otherin FIG. 2, this is for illustrative purposes, and does not necessarilycorrespond to the actual positioning of sub-frames to produce thecomposite image 204. It is also to be appreciated that the actualphysical location or grouping of projectors in a multi-projector systemcan vary. For example, while the projectors 202 in FIG. 2 are physicallyarranged in three groups of four and the sub-frames on the display aregenerally in three groups of four, the projectors could be arranged in adifferent physical position, and any of the twelve projectors 202 a-lcan be configured to produce any one of the twelve sub-frames 208 a-l.

The twelve projectors 202 are controlled by a controller system, whichcan be a computer, computer server, or other microprocessor-based systemcapable of driving the projectors to produce the composite image, asdiscussed above. The controller is designated generally at 210. However,as noted above, the controller system can include multiple computingdevices, such as a first controller computer 210 and a second controllerdevice 212 that is networked or clustered with the first controllercomputer. Similarly, the system 200 in FIG. 2 includes a camera 214 forfeedback and adjustment of the projectors 202, but can also includemultiple additional cameras 216, 218, which also provide feedback to thecalibration unit (124 in FIG. 1) that is associated with the controller210 or clustered controller group.

The multi-projector systems in FIGS. 1 and 2 are shown producing asingle composite image using all available projectors. However, it hasbeen found that it can be desirable to divide a group of projectors in amulti-projector system into sub-groups. Shown in FIG. 3 is an embodimentof a multi-projector system 300 in which the projectors 302 are dividedinto sub-groups, to produce multiple composite images 304, 306, 308 on abent backdrop-type screen 310. While this screen is shown as includingthree connected portions, it could alternatively include multipleseparate surfaces, each one addressed by a different sub-group. In thiscase, a first sub-group of three projectors 302 a-c provide threesub-frames 304 a-c that produce composite image 304, a second sub-groupof three projectors 302 d-f provide three sub-frames 306 a-c thatproduce composite image 306, and a third sub-group of three projectors302 g-i provide three sub-frames 308 a-c that produce composite image308. While the embodiment shown in FIG. 3 includes three screens, anynumber of multiple screens can be used. These multiple composite images304, 306, 308 can be produced using a single microprocessor controllersystem 312 (whether a single computer device, or multiple computers ordevices that are networked or clustered together), and can be relatedimages or independent images. The multiple composite images canrepresent multiple composite displays or multiple channels on the samecomposite display. At least one camera 314 can be oriented toward thedisplay screen 310 to provide feedback to a calibration unit (not shown)associated with the controller 312, in the manner discussed above.

As noted above, one challenge associated with producing composite imagesis consistent reproduction of color, brightness, etc., across multiplecomposite displays or multiple channels on the same composite display.This is particularly an issue where these displays are produced using asingle microprocessor system. It is generally desirable that a compositedisplay (as in FIG. 2) or group of composite displays (as in FIG. 3)have the same visual characteristics throughout (e.g. consistentbrightness, color). For example, it can be distracting for one image ina multi-screen display or one eye in a stereoscopic/3D display to differin color or brightness. Likewise, it can be undesirable if amulti-screen signage display having content that flows across thescreens exhibits differing brightness and/or color across the differentscreens.

Advantageously, the present disclosure provides various embodiments of asystem and method that have been developed to allow automatic deliveryof consistent imagery (e.g. consistent brightness, color, etc.) using amulti-projector composite display system across multiple screens and/ormultiple channels. This system and method is also useful for 3Dapplications. There are different techniques for displaying stereoscopic3D images. As is well known, stereoscopic 3D images involve left andright image pairs that are slightly different in perspective. When aviewer sees one image of the pair with the left eye and the other withthe right eye (typically with the aid of special polarized or colorfilter glasses), the effect can approximate actual human stereoscopicvision of three dimensional objects.

Some 3D projectors use time multiplexing to alternately display twochannels corresponding to left and right images. While these images canbe consistent in color and brightness (because they are produced by thesame projector), this is often obtained in a trade-off of bit depth andoverall brightness. These types of projectors can also be veryexpensive. Alternatively, dual projectors can be used for stereoscopic3D images. One projector will project the left image and the other willproject the right image. Dual projector systems often require manualcalibration and alignment, as well as balancing luminance and color sothat the two channels are consistent. These tasks generally require theservices or highly trained technicians, and can be time consuming. Also,these dual projector solutions typically have a fixed aspect ratio,fixed resolution, and fixed brightness.

Many prior 3D approaches can deliver at most two distinct views, and/orinvolve the use of 3D glasses. However, those of skill in the art willrecognize that some systems can be multi-view (i.e. deliver more thantwo views), and that autostereoscopic (not requiring glasses) displaysare also available. Autostereoscopic displays are commonly multi-view,and as a user moves his viewing position from side to side with respectto the display, the eyes receive a more appropriate pair of views togive a stereo/3D view. These displays are limited because they can onlygive a relatively small number of view zones (e.g. the object appears to“jump” in 3D as the viewer moves between view zones). Moreover, in orderto obtain these results, displays with optical elements are often used.Each view is produced by spatially multiplexing the available displaypixels (LCD or projected), thereby trading off the number of distinctviews/view zones and spatial resolution. For multi-screen solutions, itis not entirely easy to reconfigure the system to other displayconfigurations or to flow content across the screens. The display systemmay also be a full autostereoscopic continuous view 3D system.

Shown in FIG. 4 is a flow diagram illustrating a method for producingconsistent composite image characteristics across multiple displays ormultiple channels on the same display using a common microprocessorcontrol system according to one embodiment. In this method, the displaysystem is assumed to be a multi-projector display system like that shownand described in any of FIGS. 1-3, consisting of a collection ofprojectors, multiple graphic cards, one or more PCs clustered together,one or more calibration cameras, and one or more display surfaces. Thesystem could be easily configured to display multiple screenssimultaneously (displaying different content or even related content).

The first step 400 in the method is to divide the projectors intophysical sub-groups. The multi-projector system disclosed hereinincludes at least two sub-groups of at least one projector each.However, different numbers of projectors per sub-group and differentnumbers of sub-groups can be used. For example, the system shown in FIG.3 includes three sub-groups of three projectors. It will be appreciatedthat the sub-groups in a given multi-projector system can have differentnumbers of projectors in the sub-groups. For example, a system witheight projectors can be divided into two sub-groups with threeprojectors each, and a third sub-group with two projectors.

The projectors are grouped to cover the different screens or channelsthat are associated with the multi-projector system. Each projector isassigned to exactly one sub-group at any one time, though of course thesystem can be reconfigured when desired to reassign the projectors todifferent sub-groups. As noted above, the display system usescentralized resources (cameras, PCs, etc), and can be front- orrear-projected or both. Mixed projector technologies can also be used.For example, some projectors in the system can be LCD projectors, whileothers are DMD devices.

Once the projectors have been mapped to the different sub-groups, thenext step 402 can be to pre-calibrate the calibration camera(s) toaccount for differences from the underlying mathematical model. In oneembodiment, an amount of lens distortion for each calibration camera, aswell as the relative orientation and position of each camera, iscalculated using a known calibration pattern or chart. Once computed,the control system can precompensate each subsequently captured image toaccount for the lens distortion and relative geometry. The color spaceof the camera can also be corrected by pre-calibrating the camera usinga device like a spectrophotometer, and then pre-compensating capturedimages with color transformations.

In another embodiment, the vignetting effect is estimated and eliminatedfor each calibration camera. As will be appreciated by those of skill inthe art, light intensity detection can vary across the field of view ofa given camera. In particular, there can be a reduction in lightintensity detection at the margins of the image. It is desirable tocompensate for this “vignetting” effect (also called a luminance profileor intensity profile) for each camera. This compensation is oftenperformed by using a flat white physical target of known intensitycharacteristics. By viewing that pattern with each calibration cameraand measuring the luminance intensity variation of the resulting imagevia the calibration unit, this allows the system to estimate theintensity vignetting based upon spatial variation of intensity detectionacross the calibration pattern image. Once the intensity variation isknown, the control system can postcompensate each subsequently capturedimage, so that all images captured by that camera will not suffer fromthe vignetting effect. In this way, the camera(s) become pre-calibratedto give accurate comparative intensity readings.

As suggested by arrow 412 in FIG. 4, the process can move from step 400to step 404, without pre-calibrating the cameras. Whether the camera(s)are pre-calibrated or not, the next step 404 is to specify the targetcharacteristics between the sub-groups of projectors. Targetcharacteristics for each sub-group are specified with respect to one ormore of the other sub-groups. For example, it is desirable that theluminance profile and color gamut of sub-group #1 and sub-group #2 besimilar, or at least consistent. As another example, it can be desirablefor the sub-groups to conform to the same reference bounding box (e.g.for stereo 3D output). Thus, this step involves identifying theparameters and the constraint function(s) relating the projectorsub-groups.

In some cases, this step involves first using modeling and measurementsteps for each sub-group. Examples of these modeling and measurementsteps include calibrating the projection brightness of each sub-group tobe as uniform as possible. In one embodiment, the image pipeline for themulti-projector system uses a sophisticated image formation model andautomatic measurement steps via feedback through the calibrationcamera(s), including measuring the inter-projector geometry, luminance,color, black offset, etc. These modeling and measurement steps areoutlined in N. Damera-Venkata, N. L. Chang, J. M. DiCarlo, “A UnifiedParadigm for Scalable Multi-Projector Displays,” IEEE Transactions onVisualization and computer Graphics, November-December 2007, and in U.S.Pat. Nos. 7,306,341, and 7,443,364, and United States Patent ApplicationPublication Nos. 2007/0091277, 2007/0097334, 2008/0002160, 2008/0024469,2008/0024683, and 2008/0143978, the disclosures of which areincorporated by reference herein.

As described in the above references, a series of patterns are projectedby a set of projectors and subsequently captured by the camera(s) toestimate the calibration parameters with respect to the imaging model.In one embodiment, based on the linearity of light, the model is asummation of each projector's light output, after undergoing anygeometric transformations, resampling, luminance variations, color gamutchanges, as well as inherent light leakage (or black offset). Onceestimated, the calibration parameters facilitate an accurate predictionof the projectors' final image. As described in the above references,desired target parameters (e.g. luminance profile for the entireprojector system, color gamut, etc) are chosen for the set ofprojectors, and rendering parameters for each projector are optimizedbased on the desired target parameters. The rendering parametersencapsulate the information needed to make each sub-group appear asthough the output came from a single projector (i.e. so that the outputappears seamless and achieves certain desired image properties). Forexample, this approach helps ensure that the geometry, luminance, andcolor of the resulting image are consistent throughout the set ofprojectors. In the system and method disclosed herein, each sub-group ofprojectors undergoes this modeling and measurement process.

Once the target characteristics for the sub-groups have been specified,the next step 406 is to determine the target parameters (brightness,color, etc) for each sub-group to ensure consistent rendering across allsub-groups. In other words, projection values for brightness, color,etc. are assigned to the projectors in the different sub-groups so thatthe final projected images are consistent between sub-groups withrespect to these parameters. In the example of multi-channelstereoscopic 3D, this step can include scaling down the brighter of thetwo target luminance surfaces corresponding to the “left” and “right”sub-groups. Normally with multiple projectors there can be brightnessdiscontinuities and seams, etc. In order to make the output frommultiple individual projectors appear as if it came from a singleprojector, one with a particular smoothly varying luminancesurface/profile, the target luminance surface of one sub-group may besubstantially brighter than one obtained for a second sub-group, so thiswould also need to be factored in during calibration.

As another example, the system can examine the chromaticity of theprojectors in each sub-group and take the intersection gamut of thecolor space of all the projectors in each sub-group to ensure that allcontent can be feasible in color. After the above measuring and modelingsteps are performed for each sub-group, the resulting calibrationparameters are adjusted so that the color gamut of one sub-group doesnot vary significantly from a second one, thereby ensuring consistencyacross sub-groups. The calibration camera captures these images, and thecalibration unit analyzes the chromaticity of the respective projectorto determine the full range of color values that the projector canproduce. When this is done for all projectors, the intersection gamutrepresents the full range of color values that all projectors canproduce. Information regarding the intersection gamut of availablecolors can be used to allow the system to select color values that arewithin the available color space for any projection color values thatmay fall outside that space. This allows a color that cannot beaccurately rendered by all projectors to be adjusted to the closestcolor within the common color space, so that all sub-groups project thesame color for a given color value.

Following the determination of the target parameters for the differentsub-groups, the next step 408 is to compute the rendering parameters forthe entire system using the parameters for each sub-group. For thepurposes of rendering, each sub-group is regarded as a separate“display”. The multi-projector system computes the projectiondifferences among the projectors in a given sub-group and then solvesfor the parameters needed to adjust each projector so that whencombined, the final result looks seamless and exhibits the desiredtarget characteristics. In one embodiment, a training algorithm isexecuted to efficiently compute these rendering parameters. This processis outlined in U.S. Patent Application Publication No. 2008/0024469.

In the last step 410 shown in FIG. 4, appropriate display content issent to each projector in each sub-group at display time. When it isdesired to display some content, the computed rendering parameters areapplied to every desired frame to determine how to adjust eachprojector's image so that when projected in the sub-group configuration,the resulting image achieves the desired characteristics. Because of theforegoing calibration steps, the system can display distinct, related,or identical content via each sub-group, with consistent displaycharacteristics in each sub-group. In this way, one can treat amulti-screen display as a connected display where the content can flowacross the sub-groups. Likewise, in the stereoscopic/3D display case,the appropriate content will be displayed in sync to the correctviewers' eyes with consistent characteristics.

One embodiment uses a multi-projector display system, such as thoseshown in FIGS. 1-3 and described above, to help provide a two-wayinteractive 3D experience for a user. FIGS. 5-7 show embodiments of asystem for providing such an interactive 3D experience.

FIG. 5 is a diagram illustrating a system 500 for providing a two-way(full-duplex) interactive 3D experience according to one embodiment. Inthe illustrated embodiment, the system 500 includes a first set ofelements in a first room (e.g., a locker room) 502 and a second set ofelements in a second room (e.g., a VIP viewing room) 504. The first setof elements in the first room 502 are communicatively coupled to thesecond set of elements in the second room 504 via a two-waycommunication link 514. In one embodiment, the communication link 514 isa fiber video network (e.g., multiple fiber/HD-SDI links) or a datanetwork. In one embodiment, rooms 502 and 504 are at geographicallydispersed locations.

The first room 502 includes a display 506, a video capture device 508,and audio/video controls 510. In one embodiment, the display 506 is a 2DLiquid Crystal Display (LCD) display device, and the video capturedevice 508 is a high-definition (HD) 3D video capture device that isconfigured to capture HD 3D images of a person (e.g., a professionalathlete) 512 and capture associated audio. In another embodiment,display device 506 is a 3D display device. The second room 504 includesa display 516, a video capture device 518, audio input devices 522, andaudio/video controls 524. In one embodiment, the display 516 includes amulti-projector image display system, such as system 100 shown in FIG.1, which is configured to display HD 3D images and output associatedaudio. The HD 3D images captured by device 508 are transmitted todisplay 516 via communication link 514, and the captured images aredisplayed on display 516. In one embodiment, the video capture device518 is a 2D video capture device that is configured to capture 2D videoimages of one or more persons (e.g., VIPs) 520 and associated audio. The2D video images and audio captured by device 518 are transmitted todisplay 506 via communication link 514, and the captured images aredisplayed on display 506. In another embodiment, the video capturedevice 518 is a 3D video capture device. Audio input devices 522 areconfigured to capture audio information, which is transmitted to display506 for output by display 506.

Audio/video controls 510 in room 502 are configured to control thecapture and output of audio and video information by capture device 508and display 506, and control the exchange of audio and video informationwith the elements of room 504. Audio/video controls 524 in room 504 areconfigured to control the capture and output of audio and videoinformation by capture device 518 and display 516, and control theexchange of audio and video information with the elements of room 502.The audio/video controls 510 and 524 may also be used to helpsynchronize the video and audio channels, as well as reduce/cancel echo.Spatial audio may also be included so that, for example, person 512 candetermine who is talking. The system may also be configured to allowVIPS 520 to view and interact with multiple professional athletes 512 atone time.

In one embodiment, display 516 provides a life-sized, life-like, andnatural aspect ratio celebrity wall experience for immersiveentertainment. The two-way 3D celebrity wall enables a sports athlete orartist to talk to fans virtually, as though just like being there.Display 516 according to another embodiment includes a life-sized,superwide display that provide a just-like-being-there 3D courtsideexperience at a basketball game or a life-sized display thatdemonstrates various 3D views of a clothing line for fashion/retail.

To achieve the life sizes for an immersive 3D display, one embodiment ofdisplay 516 uses multiple projectors to create a high quality, highresolution, seamless, and yet cost effective solution. Similarly, videocapture device 508 is used to capture imagery with appropriateresolution and aspect ratio. In one embodiment, display 516 displaysimages of people and objects at between about 80% to 120% of the actualsize of these people and objects.

System 500 allows special guests (e.g., VIPs 520) the opportunity tointeract with talent (e.g., professional athlete 512) in ways they havenever experienced before. Utilizing a substantially life-sized display516 and a 3D video capture device 508, when the special guests interactwith the talent, they will have a true-to-life experience and thefeeling of actually meeting them in-person, without the talent actuallybeing in the same location.

In one embodiment, display 516 has a size and aspect ratio that areappropriate for the talent. For example, in one embodiment, the display516 is about 5′×8′ to create a life-like experience of interacting witha professional athlete. In other embodiments, the display 516 is a 1:1ratio (e.g., 8′×8′), which may be more appropriate for situations inwhich a VIP is viewing multiple athletes/celebrities at the same time.The display 516 creates a seamless 3D display in the appropriate aspectratio. Geometric and color differences among the projectors in display516 are automatically corrected to deliver a high quality result.Likewise, on the celebrity side (i.e., in room 502), video capturedevice 508 includes two or more cameras to form the appropriate 3Dimagery in an appropriate aspect ratio. For example, for a more portraitoriented display, two portrait oriented high-definition (HD) cameras areused to capture portrait oriented HD 3D imagery.

FIG. 6 is a diagram illustrating a system 600 for providing a two-way(full-duplex) interactive 3D experience according to another embodiment.In the illustrated embodiment, the system 600 includes a first set ofelements in a first room (e.g., a locker room) 602 and a second set ofelements in a second room (e.g., a VIP viewing room) 604. The first setof elements in the first room 602 are communicatively coupled to thesecond set of elements in the second room 604 via a two-waycommunication link 618. In one embodiment, the communication link 618 isa fiber video network (e.g., multiple fiber/HD-SDI links) or a datanetwork. In one embodiment, rooms 602 and 604 are at geographicallydispersed locations.

The first room 602 includes displays 606 and 608, a video capture device610, audio/video controls 612, and audio input device 614. In oneembodiment, displays 606 and 608 are 2D LCD displays, and the videocapture device 610 is a high-definition (HD) 3D video capture devicethat is configured to capture HD 3D video images of a person (e.g., aprofessional athlete) 616. In another embodiment, displays 606 and 608are 3D display devices. Displays 606 and 608 may also be implementedwith a single physical display device (e.g., by displaying multiplewindows on the single display device). Audio input device 614 isconfigured to capture audio from person 616. The second room 604includes a display 620, video capture devices 622 and 628, audio inputdevice 626, and audio/video controls 632. In one embodiment, the display620 includes a multi-projector image display system, such as system 100shown in FIG. 1, which is configured to display HD 3D images and outputassociated audio. The HD 3D images captured by device 610 aretransmitted to display 620 via communication link 618, and the capturedimages are displayed on display 620.

In one embodiment, the video capture device 622 is a 2D video capturedevice that is configured to capture 2D video images of one or morepersons (e.g., VIP) 624 and associated audio. The 2D video images andaudio captured by device 622 are transmitted to display 606 viacommunication link 618, and the captured images are displayed on display606. In one embodiment, the video capture device 628 is a 2D videocapture device that is configured to capture 2D video images of one ormore persons (e.g., VIP crowd) 630 and associated audio. The 2D videoimages and audio captured by device 628 are transmitted to display 608via communication link 618, and the captured images are displayed ondisplay 608. In another embodiment, one or both of video capture devices622 and 628 are 3D video capture devices. Audio input device 626 isconfigured to capture audio information, which is transmitted to display606 for output by display 606.

Audio/video controls 612 in room 602 are configured to control thecapture and output of audio and video information by capture device 610and displays 606 and 608, and control the exchange of audio and videoinformation with the elements of room 604. Audio/video controls 632 inroom 604 are configured to control the capture and output of audio andvideo information by capture devices 622 and 628 and display 620, andcontrol the exchange of audio and video information with the elements ofroom 602. The audio/video controls 612 and 632 may also be used to helpsynchronize the video and audio channels, as well as reduce/cancel echo.Spatial audio may also be included. The system may also be configured toallow VIPS to view and interact with multiple professional athletes atone time.

In one embodiment, display 620 provides a life-sized, life-like, andnatural aspect ratio celebrity wall experience for immersiveentertainment. The two-way 3D celebrity wall enables a sports athlete orartist to talk to fans virtually, as though just like being there.Display 620 according to another embodiment includes a life-sized,superwide display that provide a just-like-being-there 3D courtsideexperience at a basketball game or a life-sized display thatdemonstrates various 3D views of a clothing line for fashion/retail.

To achieve the life sizes for an immersive 3D display, one embodiment ofdisplay 620 uses multiple projectors to create a high quality, highresolution, seamless, and yet cost effective solution. Similarly, videocapture device 610 is used to capture imagery with appropriateresolution and aspect ratio. In one embodiment, display 620 displaysimages of people and objects at between about 80% to 120% of the actualsize of these people and objects.

System 600 allows special guests (e.g., VIP 624) the opportunity tointeract with talent (e.g., professional athlete 616) in ways they havenever experienced before. Utilizing a life-sized display 620 and a 3Dvideo capture device 610, when the special guests interact with thetalent, they will have a true-to-life experience and the feeling ofactually meeting them in-person, without the talent actually being inthe same location. In particular, having a question and answer area forVIP 624 to ask a question allows individualized and eye-to-eyeexperiences for the questioner to feel like he or she is directlyinteracting with the talent. Moreover, having displays 606 and 608 onthe talent side allows the talent to have a sense of their fans plus thepersonalized experience with the questioner.

In one embodiment, display 620 has a size and aspect ratio that areappropriate for the talent. For example, in one embodiment, the display620 is about 5′×8′ to create a life-like experience of interacting witha professional athlete. The display 620 creates a seamless 3D display inthe appropriate aspect ratio. Geometric and color differences among theprojectors in display 620 are automatically corrected to deliver a highquality result. Likewise, on the celebrity side (i.e., in room 602),video capture device 610 includes two or more cameras to form theappropriate 3D imagery in an appropriate aspect ratio. For example, fora more portrait oriented display, two portrait oriented high-definition(HD) cameras are used to capture portrait oriented HD 3D imagery.

FIG. 7 is a diagram illustrating a system 700 for providing a two-way(full-duplex) interactive 3D experience according to yet anotherembodiment. In the illustrated embodiment, the system 700 includes afirst set of elements in a first room (e.g., a locker room) 702, asecond set of elements in a second room (e.g., a first VIP viewing room)704, and a third set of elements in a third room (e.g., a second VIPviewing room) 706. The first set of elements in the first room 702 arecommunicatively coupled to the second set of elements in the second room704 and the third set of elements in the third room 706 via a two-waycommunication link 716. In one embodiment, the communication link 716 isa fiber video network (e.g., multiple fiber/HD-SDI links) or a datanetwork. In one embodiment, rooms 702, 704, and 706 are atgeographically dispersed locations.

The first room 702 includes display 708, a video capture device 710, andaudio/video controls 712. In one embodiment, display 708 is a 2D LCDdisplay, and the video capture device 710 is a high-definition (HD) 3Dvideo capture device that is configured to capture HD 3D video images ofa person (e.g., a professional athlete) 714 and capture associatedaudio. The second room 704 includes a display 718, and the third room706 includes a display 722. In one embodiment, the displays 718 and 722each include a multi-projector image display system, such as system 100shown in FIG. 1, which is configured to display HD 3D images and outputassociated audio. The HD 3D images captured by device 710 aretransmitted to displays 718 and 722 via communication link 716, and thecaptured images are displayed on displays 718 and 722. In oneembodiment, each of the rooms 704 and 706 includes a video capturedevice (not shown in FIG. 7) that is configured to capture 2D videoimages of one or more persons (e.g., VIPs) 720 and 724 and associatedaudio. The 2D video images and audio captured by these devices aretransmitted to display 708 via communication link 716, and the capturedimages are displayed on display 708.

Audio/video controls 712 in room 702 are configured to control thecapture and output of audio and video information by capture device 710and display 708, and control the exchange of audio and video informationwith the elements of room 704. In one embodiment, rooms 704 and 706include similar audio/video controls.

In one embodiment, displays 718 and 722 provide a life-sized, life-like,and natural aspect ratio celebrity wall experience for immersiveentertainment. The two-way 3D celebrity wall enables a sports athlete orartist to talk to fans virtually, as though just like being there.Displays 718 and 722 according to another embodiment includes alife-sized, superwide display that provide a just-like-being-there 3Dcourtside experience at a basketball game or a life-sized display thatdemonstrates various 3D views of a clothing line for fashion/retail. Insome embodiments, the displays are co-located to create a gathering ofgeographically dispersed members. An example is a music jam session orinterview where there are two 3D life-sized displays on stage for twogeographically dispersed musicians or interviewees, and where anaudience could watch (led by a moderator). This would provide a naturalexperience for the moderator and audience as well as the twogeographically dispersed members. It could be structured so that theright visual and social cues would create the right experience for allparties.

To achieve the life sizes for an immersive 3D display, one embodiment ofdisplays 718 and 722 uses multiple projectors to create a high quality,high resolution, seamless, and yet cost effective solution. Similarly,video capture device 710 is used to capture imagery with appropriateresolution and aspect ratio. In one embodiment, displays 718 and 722display images of people and objects at between about 80% to 120% of theactual size of these people and objects.

System 700 allows special guests (e.g., VIPs 720 and 724) theopportunity to interact with talent (e.g., professional athlete 714) inways they have never experienced before. Utilizing life-sized displays718 and 722 and a 3D video capture device 710, when the special guestsinteract with the talent, they will have a true-to-life experience andthe feeling of actually meeting them in-person, without the talentactually being in the same location.

In one embodiment, displays 718 and 722 have a size and aspect ratiothat are appropriate for the talent. For example, in one embodiment, thedisplays 718 and 722 are each about 5′×8′ to create a life-likeexperience of interacting with a professional athlete. The displays 718and 722 create a seamless 3D display in the appropriate aspect ratio.Geometric and color differences among the projectors in displays 718 and722 are automatically corrected to deliver a high quality result.Likewise, on the celebrity side (i.e., in room 702), video capturedevice 710 includes two or more cameras to form the appropriate 3Dimagery in an appropriate aspect ratio. For example, for a more portraitoriented display, two portrait oriented high-definition (HD) cameras areused to capture portrait oriented HD 3D imagery.

It will be understood that FIGS. 5-7 are simplified representations, andthat the various rooms shown in these Figures may include additional ordifferent elements than those shown.

FIG. 8 is a block diagram illustrating elements 800 of the system 700shown in FIG. 7 for providing audio and video information from the firstroom 702 to the second and third rooms 704 and 706 according to oneembodiment. Room 702 includes 3D preview monitor 808, audio embedder810, audio mixer/echo/delay unit 812, scalers 814 and 816, 3GSDIsplitters 818 and 822, synchronization unit 820, HDMI camera left 824,and HDMI camera right 826. Cameras 824 and 826 are represented by videocapture device 710 in FIG. 7. Room 704 includes audio mixer/echo/delayunit 828, audio de-embedder 830, and display 718. Room 706 includesaudio mixer/echo/delay unit 834, audio de-embedder 836, and display 722.

Cameras 824 and 824 capture left and right eye images, respectively, forgenerating 3D video, and provide the images to scalers 814 and 816,respectively. Synchronization unit 820 synchronizes the scalers 814 and816. Scalers 814 and 816 scale the received images, and output thescaled images to 3D preview monitor 808 for previewing the 3D video.Scaler 814 also outputs the scaled, left-eye images to audio embedder810. Audio embedder 810 receives associated audio from unit 812, embedsthe audio in the received image stream, and outputs an audio and videostream to 3GSDI splitter 818. 3GSDI splitter 818 outputs the receivedaudio and video stream to audio de-embedders 830 and 836. Scaler 816outputs the scaled, right-eye images to 3GSDI splitter 822, whichoutputs the received images to displays 718 and 722.

Audio de-embedders 830 and 836 remove the audio from the audio and videostreams received from 3GSDI splitter 818, output the audio to units 828and 834, respectively, and output the left-eye images from the audio andvideo stream to displays 718 and 722, respectively. Display 718generates a 3D display based on the left-eye images received from unit830 and the right-eye images received from splitter 822. Similarly,display 722 generates a 3D display based on the left-eye images receivedfrom unit 836 and the right-eye images received from splitter 822. Audiomixer/echo/delay units 828 and 834 perform mixing, echo, and delayfunctions on the received audio prior to outputting the audio.

FIG. 9 is a block diagram illustrating elements 900 of the system 700shown in FIG. 7 for providing audio and video information from thesecond room 704 and the third room 706 to the first room 702 accordingto one embodiment. Room 702 includes display 708, 3GSDI switcher 910,audio de-embedder 912, audio mixer/echo/delay unit 914, and audiode-embedder 916. Room 704 includes audio mixer/echo/delay unit 918,audio embedder 920, HDMI to HDSDI scaler 922, and HDMI camera 924. Room706 includes audio mixer/echo/delay unit 926, audio embedder 928, HDMIto HDSDI scaler 930, and HDMI camera 932.

HDMI camera 924 captures HD images in room 704 (e.g., of VIPs 720), andoutputs the images to scaler 922. Scaler 922 scales the received images,and outputs the scaled images to audio embedder 920. Audiomixer/echo/delay unit 918 performs mixing, echo, and delay functions onthe audio captured in the room 704, and outputs the audio to audioembedder 920. Audio embedder 920 adds the received audio to the receivedscaled images, and outputs an audio and video stream to audiode-embedder 912.

HDMI camera 932 captures HD images in room 706 (e.g., of VIPs 724), andoutputs the images to scaler 930. Scaler 930 scales the received images,and outputs the scaled images to audio embedder 928. Audiomixer/echo/delay unit 926 performs mixing, echo, and delay functions onthe audio captured in the room 706, and outputs the audio to audioembedder 928. Audio embedder 928 adds the received audio to the receivedscaled images, and outputs an audio and video stream to audiode-embedder 916.

Audio de-embedders 912 and 916 remove the audio from the received audioand video streams, provide the audio to audio mixer/echo/delay unit 914,and provide the image streams to 3GSDI switcher 910. Audiomixer/echo/delay unit 914 performs mixing, echo, and delay functions onthe received audio prior to outputting the audio. Switcher 910 receivesthe room 704 image stream from audio de-embedder 912 and receives theroom 706 image stream from audio de-embedder 916, and selectivelyoutputs one of these streams to display 708 based on user input. Display708 displays the selected image stream.

FIG. 10 is a flow diagram illustrating a method 1000 for providing atwo-way interactive 3D experience according to one embodiment. At 1002,a first set of images of a first person in a first location (e.g., room)is captured with a first video capture system. At 1004, a second set ofimages of a second person in a second location (e.g., room) is capturedwith a second video capture system. At 1006, the second set of images istransmitted to a first display system in the first room for display. At1008, the first set of images is transmitted to a second display systemin the second room for display. At 1010, a substantially life-sized 3Ddisplay of the first person is generated on the second display based onthe first set of images.

In one embodiment of method 1000, the first video capture system is aportrait-oriented video capture system, and the second display system isa portrait-oriented display system. The method 1000 according to oneembodiment further includes displaying 3D images of the first person onthe second display at between about 80% to 120% of actual size of thefirst person. In one embodiment, the first room and the second room aregeographically dispersed. Method 1000 according to one embodimentfurther includes: capturing a third set of images of a third person in athird location (e.g., room) with a third video capture system;transmitting the third set of images to the first display system in thefirst room for display; transmitting the first set of images to a thirddisplay system in the third room for display; and generating asubstantially life-sized 3D display of the first person on the thirddisplay based on the first set of images. In one embodiment of method1000, the second display system comprises a multi-projector displaysystem.

Another embodiment is directed to a system for providing a two-wayinteractive 3D experience. The system includes a first video capturesystem configured to capture a first set of images of a first person ina first location, and a first display system in the first location. Asecond video capture system is configured to capture a second set ofimages of a second person in a second location. A second display systemis in the second location. A two-way communication link is configured todeliver the first set of images to the second display system for displayand deliver the second set of images to the first display system fordisplay. The second display system is configured to generate asubstantially life-sized 3D display of the first person based on thefirst set of images.

In one form of this embodiment, the first video capture system is aportrait-oriented video capture system, and the second display system isa portrait-oriented display system. The second display system accordingto one embodiment is configured to display images of the first person atbetween about 80% to 120% of actual size of the first person. In oneembodiment, the first location and the second location aregeographically dispersed.

In one embodiment, the system includes a third video capture systemconfigured to capture a third set of images of a third person in a thirdlocation, and a third display system in the third location. Thecommunication link is configured to deliver the first set of images tothe third display system for display and deliver the third set of imagesto the first display system for display. The third display system isconfigured to generate a substantially life-sized 3D display of thefirst person based on the first set of images.

In one embodiment of the system, the second display system comprises amulti-projector display system. In one form of this embodiment, thefirst set of images comprises a first channel of stereoscopic 3D displaydata and a second channel of stereoscopic 3D display data, and themulti-projector display system includes: a first sub-group of projectorsconfigured to receive the first channel of stereoscopic 3D display data;and a second sub-group of projectors configured to receive the secondchannel of stereoscopic 3D display data. The first and second sub-groupsare configured to superimposedly project images to a common displaylocation to provide a stereoscopic 3D display. In another form of thisembodiment, the first set of images comprises a first channel of 3Ddisplay data and a second channel of 3D display data, and themulti-projector display system includes: a first sub-group of projectorsconfigured to receive the first channel of 3D display data; and a secondsub-group of projectors configured to receive the second channel of 3Ddisplay data. The first and second sub-groups are configured tosuperimposedly project images to a common display location to provide adisplay having multiple views. In yet another form of this embodiment,the first set of images comprises a first channel of 3D display data anda second channel of 3D display data, and the multi-projector displaysystem includes: a first sub-group of projectors configured to receivethe first channel of 3D display data; and a second sub-group ofprojectors configured to receive the second channel of 3D display data.The first and second sub-groups are configured to superimposedly projectimages to a common display location to provide a display having fullautostereoscopic continuous view 3D.

In one embodiment, the two-way communication link is configured todeliver audio information captured in the first location to the secondlocation, and deliver audio information captured in the second locationto the first location. The two-way communication link according to oneembodiment comprises a fiber video network.

Although specific embodiments have been illustrated and describedherein, it will be appreciated by those of ordinary skill in the artthat a variety of alternate and/or equivalent implementations may besubstituted for the specific embodiments shown and described withoutdeparting from the scope of the present invention. This application isintended to cover any adaptations or variations of the specificembodiments discussed herein. Therefore, it is intended that thisinvention be limited only by the claims and the equivalents thereof.

1. A system for providing a two-way interactive 3D experience, thesystem comprising: a first video capture system configured to capture afirst set of images of a first person in a first location; a firstdisplay system in the first location; a second video capture systemconfigured to capture a second set of images of a second person in asecond location; a second display system in the second location; atwo-way communication link configured to deliver the first set of imagesto the second display system for display and deliver the second set ofimages to the first display system for display; and wherein the seconddisplay system is configured to generate a substantially life-sized 3Ddisplay of the first person based on the first set of images.
 2. Thesystem of claim 1, wherein the first video capture system is aportrait-oriented video capture system.
 3. The system of claim 1,wherein the second display system is a portrait-oriented display system.4. The system of claim 1, wherein the first location and the secondlocation are geographically dispersed.
 5. The system of claim 1, andfurther comprising: a third video capture system configured to capture athird set of images of a third person in a third location; a thirddisplay system in the third location; wherein the communication link isconfigured to deliver the first set of images to the third displaysystem for display and deliver the third set of images to the firstdisplay system for display, and wherein the third display system isconfigured to generate a substantially life-sized 3D display of thefirst person based on the first set of images.
 6. The system of claim 1,wherein the second display system comprises a multi-projector displaysystem.
 7. The system of claim 6, wherein the first set of imagescomprises a first channel of stereoscopic 3D display data and a secondchannel of stereoscopic 3D display data, and wherein the multi-projectordisplay system comprises: a first sub-group of projectors configured toreceive the first channel of stereoscopic 3D display data; a secondsub-group of projectors configured to receive the second channel ofstereoscopic 3D display data; and wherein the first and secondsub-groups are configured to superimposedly project images to a commondisplay location to provide a stereoscopic 3D display.
 8. The system ofclaim 6, wherein the first set of images comprises a first channel of 3Ddisplay data and a second channel of 3D display data, and wherein themulti-projector display system comprises: a first sub-group ofprojectors configured to receive the first channel of 3D display data; asecond sub-group of projectors configured to receive the second channelof 3D display data; and wherein the first and second sub-groups areconfigured to superimposedly project images to a common display locationto provide a display having multiple views.
 9. The system of claim 6,wherein the first set of images comprises a first channel of 3D displaydata and a second channel of 3D display data, and wherein themulti-projector display system comprises: a first sub-group ofprojectors configured to receive the first channel of 3D display data; asecond sub-group of projectors configured to receive the second channelof 3D display data; and wherein the first and second sub-groups areconfigured to superimposedly project images to a common display locationto provide a display having full autostereoscopic continuous view 3D.10. The system of claim 1, wherein the two-way communication link isconfigured to deliver audio information captured in the first locationto the second location, and deliver audio information captured in thesecond location to the first location.
 11. A method for providing atwo-way interactive 3D experience, the method comprising: capturing afirst set of images of a first person in a first location with a firstvideo capture system; capturing a second set of images of a secondperson in a second location with a second video capture system;transmitting the second set of images to a first display system in thefirst location for display; transmitting the first set of images to asecond display system in the second location for display; and generatinga substantially life-sized 3D display of the first person on the seconddisplay based on the first set of images.
 12. The method of claim 11,wherein the first video capture system is a portrait-oriented videocapture system, and the second display system is a portrait-orienteddisplay system.
 13. The method of claim 11, wherein the first locationand the second location are geographically dispersed.
 14. The method ofclaim 11, and further comprising: capturing a third set of images of athird person in a third location with a third video capture system;transmitting the third set of images to the first display system in thefirst location for display; transmitting the first set of images to athird display system in the third location for display; and generating asubstantially life-sized 3D display of the first person on the thirddisplay based on the first set of images.
 15. The method of claim 11,wherein the second display system comprises a multi-projector displaysystem.
 16. A system for providing a two-way interactive 3D experience,the system comprising: a first video capture system configured tocapture a first set of images of a first person in a first location; afirst display system in the first location; a second video capturesystem configured to capture a second set of images of a second personin a second location; a multi-projector display system in the secondlocation; a two-way communication link configured to deliver the firstset of images to the multi-projector display system for display anddeliver the second set of images to the first display system fordisplay; and wherein the multi-projector display system is configured togenerate a substantially life-sized, portrait-oriented, 3D display ofthe first person based on the first set of images.
 17. The system ofclaim 1, wherein the substantially life-sized 3D display of the firstperson is generated in a substantially live manner.
 18. The system ofclaim 1, wherein the first set of images comprises multiple channels of3D display data.
 19. The system of claim 1, wherein the first videocapture system comprises a high-definition (HD) 3D video capture system.20. The system of claim 1, wherein the substantially life-sized 3Ddisplay of the first person is at least about 40 square feet in size.21. The system of claim 1, wherein the substantially life-sized 3Ddisplay of the first person comprises more than two views.